Interactive Free-Viewpoint Video

This paper introduces a representation for multiple view video to support high-quality interactive free-viewpoint rendering of moving people. Multiple wide baseline views are integrated into a view-dependent representation based on pair wise refinement of the visual-hull. An exact viewdependent visual-hull (VDVH) algorithm is presented to compute an initial approximation of the scene geometry. Refinement of the VDVH surface is then performed using photo-consistency and stereo. Interactive rendering with user control of viewpoint is achieved by front-to-back rendering of the refined surfaces with view-dependent texture. Results demonstrate that this representation achieves high-quality rendering of moving people from wide-baseline views without the visual-artefacts associated with previous visual-hull and photo-hull approaches.